Description

As the title says.

Now it looks like

Step 0: {'eval/gsm8k-eval/finished_task_count': 1319, 'eval/gsm8k-eval/accuracy/mean@4': 0.34154662623199394, 'eval/gsm8k-eval/accuracy/std@4': 0.2833624429507763, 'eval/gsm8k-eval/accuracy/best@2/mean': 0.46970053070507956, 'eval/gsm8k-eval/accuracy/best@2/std': 0.2601951934227904, 'eval/gsm8k-eval/accuracy/worst@2/mean': 0.21339878695981807, 'eval/gsm8k-eval/accuracy/worst@2/std': 0.22732260946377386, 'eval/gsm8k-eval/accuracy/best@4/mean': 0.582379833206975, 'eval/gsm8k-eval/accuracy/best@4/std': 0.187753964514041, 'eval/gsm8k-eval/accuracy/worst@4/mean': 0.12428809704321456, 'eval/gsm8k-eval/accuracy/worst@4/std': 0.13311398785210515, 'eval/gsm8k-eval/format_score/mean@4': 0.04791508718726308, 'eval/gsm8k-eval/format_score/std@4': 0.060430579521288934, 'eval/gsm8k-eval/format_score/best@2/mean': 0.07519408642911297, 'eval/gsm8k-eval/format_score/best@2/std': 0.043823375514568795, 'eval/gsm8k-eval/format_score/worst@2/mean': 0.020637604245640644, 'eval/gsm8k-eval/format_score/worst@2/std': 0.06012139017838808, 'eval/gsm8k-eval/format_score/best@4/mean': 0.09088036391205459, 'eval/gsm8k-eval/format_score/best@4/std': 0.02081875469787524, 'eval/gsm8k-eval/format_score/worst@4/mean': -0.006707808946171337, 'eval/gsm8k-eval/format_score/worst@4/std': 0.04779745171526119, 'eval/gsm8k-eval/time/run_execution/mean': 1.8486472846342814, 'eval/gsm8k-eval/time/run_execution/std': 0.7957768482777444, 'eval/gsm8k-eval/time/task_execution/mean': 2.0765281061587504, 'eval/gsm8k-eval/time/task_execution/std': 0.8317681867952945, 'time/eval': 77.17239356040955}

Checklist

Please check the following items before code is ready to be reviewed.

• Code has passed all tests
• Docstrings have been added/updated in Google Style
• Documentation has been updated
• Code is ready for review